Identification using mobile device signatures and cameras

ABSTRACT

A mesh of existing infrastructures is usable to identify user identities and communications devices with physical objects (e.g., transportation vehicles, apparel, etc.). A system can receive image data representative of images of physical objects captured (e.g., by a camera) at locations. The system can also receive signal data representative of signals from communications devices. Based on time data and location data associated with the image data and the signal data, the system can, after multiple iterations, determine whether one of the physical objects is correlated with one of the communications devices. In response to a correlation, the system can store in a record data (e.g., a container, database, etc.) data elements representative of the physical object and a second data element associated with the communications device.

RELATED APPLICATIONS

The subject patent application is a continuation of, and claims priorityto each of, U.S. patent application Ser. No. 16/744,553, filed Jan. 16,2020, and entitled “IDENTIFICATION USING MOBILE DEVICE SIGNATURES ANDCAMERAS,” which is a continuation of U.S. patent application Ser. No.15/828,707 (now U.S. Pat. No. 10,579,887), filed Dec. 1, 2017, andentitled “IDENTIFICATION USING MOBILE DEVICE SIGNATURES AND CAMERAS,”the entireties of which applications are hereby incorporated byreference herein.

TECHNICAL FIELD

The present application relates generally to the field of dataprocessing and more specifically to using images of physical objectscaptured at locations, as well as signals comprising device signatures,to associate the physical objects with mobile devices and users.

BACKGROUND

Communications devices, such as mobile phones, smart watches, laptops,cars with OnStar, Wi-Fi cameras, RFID cards, etc. are ubiquitous. Eachperson may carry one or more devices that have some kind of digitalmobile signature (e.g., identifier), be it cellular in nature,Bluetooth, Wi-Fi, or RFID. Some of these digital signatures usually canbe used to identify an individual, and sometimes can at least be used toidentify the device. Even though the devices may change through time,each of the devices carried by an individual usually has adistinguishable signature from another individual or another device, andindividuals can carry each of such devices for several years. Publicimage capturing devices have also become more and more ubiquitous,whether they are storefront security cameras, traffic cameras, tollboothcameras, or other cameras placed in a variety to locations to monitorevents and persons. The ubiquitous nature of cameras and receivers thatcan receive signals from communications devices can presentopportunities to gather and correlate information.

BRIEF DESCRIPTION OF THE DRAWINGS

Non-limiting and non-exhaustive embodiments of the subject disclosureare described with reference to the following figures, wherein likereference numerals refer to like parts throughout the various viewsunless otherwise specified.

FIG. 1 is a diagram illustrating an example system and networkingenvironment.

FIG. 2 is a diagram illustrating an example system and networkingenvironment in which a user identity's associated communications devicescommunicate with receivers.

FIG. 3 is a diagram illustrating an example identification analysis andassociation system in accordance with various aspects and embodiments ofthe subject disclosure.

FIG. 4 is a diagram illustrating an example traffic intersection havingmotor vehicles and communications devices.

FIG. 5 is a chart illustrating an example container (e.g., database,record) illustrating the association of communications devices withvehicles in accordance with various aspects and embodiments of thesubject disclosure.

FIG. 6 is a diagram illustrating an example container for a physicalobject (e.g., motor vehicle) in accordance with various aspects andembodiments of the subject disclosure.

FIG. 7 is a diagram illustrating an example a container for a useridentity in accordance with various aspects and embodiments of thesubject disclosure.

FIG. 8 is a diagram illustrating an example of a tollbooth wherein thedriver of the vehicle can be identified as a result of associations madeby an example identification analysis and association system inaccordance with various aspects and embodiments of the subjectdisclosure.

FIG. 9-11 illustrate example flow diagrams relating to operations thatcan be performed in accordance with various aspects and embodiments ofthe subject disclosure.

FIG. 12 illustrates an example block diagram of a computer that can beoperable to execute processes and methods in accordance with variousaspects and embodiments of the subject disclosure.

FIG. 13 illustrates an example block diagram of a mobile handset thatcan be operable to execute processes and methods in accordance withvarious aspects and embodiments of the subject disclosure.

DETAILED DESCRIPTION

The following description and the annexed drawings set forth in detailcertain illustrative aspects of the subject matter. However, theseaspects are indicative of but a few of the various ways in which theprinciples of the subject matter can be employed. Other aspects,advantages, and novel features of the disclosed subject matter willbecome apparent from the following detailed description when consideredin conjunction with the provided drawings. In the following description,for purposes of explanation, numerous specific details are set forth inorder to provide an understanding of the subject disclosure. It may beevident, however, that the subject disclosure can be practiced withoutthese specific details. In other instances, well-known structures anddevices are shown in block diagram form in order to facilitatedescribing the subject disclosure.

The subject disclosure of the present application describes systems andmethods, and example embodiments are described below with reference toblock diagrams and flowchart illustrations of methods, functions,apparatuses, and computer program products and modules. Steps of theblock diagrams and flowchart illustrations support combinations ofmechanisms for performing the specified functions, combinations of stepsfor performing the specified functions, and program instructions forperforming the specified functions. Example embodiments may take theform of web, mobile, wearable computer-implemented, computer software.It should be understood that each step of the block diagrams andflowchart illustrations, combinations of steps in the block diagrams andflowchart illustrations, or any operations, functions, methods, andprocesses described herein, can be implemented by computer processingsystems comprising devices having processors and memories that storeexecutable instructions (e.g., computer program product,computer-readable instructions, software, software programs, softwareapplications, etc.) that, when executed by the processors, facilitateperformance of those operations, functions, methods, and processes.

The devices can comprise a general-purpose computer, special purposecomputer, combinations of special purpose hardware and other hardware,or other programmable data processing apparatus. Examples of suchdevices can be as described in FIG. 1, and can comprise circuitry andcomponents as described in FIG. 12 and FIG. 13. The memories cancomprise any suitable computer-readable storage medium, including, forexample, hard disks, compact disks, DVDs, optical data stores, and/ormagnetic data stores. Example embodiments may take the form of entirelyhardware embodiments, entirely software embodiments, and embodimentscombining both software and hardware aspects.

The present application describes systems and methods for utilizing amesh of existing infrastructures to accurately identify users, andassociate the user (and, in example embodiments, the user'scommunications devices) with physical objects (e.g., transportationvehicles, apparel, etc.). The infrastructures comprise the RFID readers(e.g., along toll lanes, doorways, etc.), traffic cameras (e.g., camerason roads at intersections, storefront security cameras, etc.), cellularnetworks that allow devices to interact, Wi-Fi networks, and anypotential future network/client system in which communications devicesemanate signals having signatures.

The present application can be operable to use an iterative process tocapture data, analyze the captured data by combining it with previouslyanalyzed data, produce a new set of refined analysis, and offer a useridentification, communication device, and physical object associations(e.g., driver-vehicle pair identification) with a high confidence level.

In example embodiments, there is provided herein a system comprising oneor more devices, the one or more devices comprising a processor and amemory that stores executable instructions (e.g., an identification,analysis, and association IAA system) that, when executed by theprocessor, facilitate performance of operations. The operations cancomprise receiving image data representative of images of a physicalobject captured at locations, receiving signal data representative of asignal from a mobile communications device at the locations. Theoperations can also comprise, based on time data and location dataassociated with the image data and the signal data, determining whetherthe physical object is correlated to the communications device and theuser identity. Through an iterative process, a container (e.g.,electronic record) in which data representative of the physical object,user identities, and communications devices can be stored.

FIG. 1 is a diagram illustrating an example of an environment 100 inwhich communications devices belonging to an individual can accesscomputer networks, including services and functions provided through oneor more computers attached to the network, including server deviceshaving access to one or more data stores.

According to example embodiments, a system 100 in accordance with thepresent application can comprise one or more servers and communicationsdevices that execute software modules (as described above) that canfacilitate various functions, methods, and processes. As may beunderstood from this figure, the system 100 can comprise one or morecomputer networks 110, one or more servers 120, one or more data stores130 (which may contain one or more databases of information), and one ormore communications devices 140 _(1-n). (also referred to as simply ascommunications device 140, or communications devices 140).Communications device 140 can comprise, for example, a laptop computer140 ₂, a mobile phone 140 ₃ (which can be a smartphone), a tabletcomputer 140 ₄, an RFID device 140 ₅ (e.g., RFID tag, RFID chip, etc.),a Bluetooth device 140 ₆, a wearable computing device, a virtual reality(VR) device, a heads-up display (HUD) device, an “internet of things”(IoT) device, and the like. Communications device 140 can be operable tocommunicate using one or more communications methods. For example, acommunications device 140 can be cellular enabled (e.g., comprising abroadband adapter), Wi-Fi enabled (e.g., comprising a Wi-Fi adapter),Bluetooth enabled, RFID enabled, etc. In example embodiments, executableinstructions that, when executed by a processor of the communicationsdevice 140, facilitate performance of operations, can be stored on oneor more memory devices (e.g., memories) of the communications device 140(or a memory device connected to the communications device 140).

In example embodiments, a communications device 140 can communicate viaone or more communications networks (e.g., network 110), with one ormore servers (e.g., servers 120) or other computing devices. In exampleembodiments, modules comprising executable instructions that, whenexecuted by a processor of the server 120, facilitate performance ofoperations, can be stored on a memory device of the server 120 (or amemory device connected to the server).

In some embodiments, communications devices 140 running a webpage canaccess and communicate with servers 120 that are web-operable. Theseservers 120 can also be operable to send executable code capable ofgenerating graphical user interfaces (GUIs) that a user identity caninteract with to facilitate the provision of such on-line products andservices.

The one or more computer networks 110 may include any of a variety oftypes of wired or wireless computer networks such as the Internet, aprivate intranet, a public switched telephone network (PSTN), cellularnetwork, satellite network, data over cable network (e.g., operatingunder one or more data over cable service interface specification“DOCSIS”), or any other type of computer or communications network. Thecommunications networks can also comprise, for example, a Local AreaNetwork (LAN), such as an office or Wi-Fi network. The communicationsnetwork can also comprise, for example, a Bluetooth network that allowsone communications device 140 to be connected to other communicationsdevices via the Bluetooth network. The communications network can alsocomprise an RFID network that can receive RFID signals from active andpassive RFID devices.

Servers 120, data stores 130, and communications device 140, may bephysically located in (or in the case of mobile devices, can betemporarily present in) a central location, or in separate facilities.The data stores can comprise physical media housed within the one ormore servers 120, or connected to the servers 120 through one or morenetworks. In example embodiments, the one or more computer networks 110facilitate communication between the server(s) 120, data store(s) 130,and communications device 140.

FIG. 2 is an example further illustrating aspects of the componentsillustrated in FIG. 1. A user identity 205 may carry on his person (orin his transportation vehicle) a variety of communications devices 140,each of which can transmit signals to receiver(s) (e.g., sensors,receiving devices, etc.) 210 _(1-n). (also referred to as receiver 210,or receivers 210). Examples of receivers 210 can comprise cellular nodes(e.g., cellular node 210 ₂, Wi-Fi wireless access points (e.g., wirelessaccess point 210 ₃), RFID readers (e.g., RFID reader 210 ₄), Bluetoothinterface (e.g., Bluetooth interface 210 ₅). For example, the useridentity 205 may carry a laptop computer 140 ₂ that might becellular-enabled. As such, the laptop can be operable to communicatewith one or more cellular network nodes 210 ₂. The laptop can also be aWi-Fi enabled laptop, and as such, can be operable to communicate via aWi-Fi wireless access point 210 ₃.

The user identity 205 might carry a mobile phone 140 ₃ (which can be asmartphone). The smartphone 140 ₃ can be operable to communicate withone or more cellular network nodes (e.g., cellular node 210 ₂). Thesmartphone 104 ₃ can also be a Wi-Fi enabled device, and as such, can beoperable to communicate via a Wi-Fi wireless access point (e.g., Wi-Fiwireless access point 210 ₃).

The user identity 205 might carry a tablet computer 140 ₄. The tablet140 ₄ can be cellular enabled, allowing it to communicate with one ormore cellular network nodes (e.g., cellular node 210 ₂). The tablet canalso be Wi-Fi enabled, allowing it to communicate via a Wi-Fi wirelessaccess point (e.g., Wi-Fi wireless access point 210 ₃).

The user identity 205 might carry a communication device 140 that is anRFID device 140 ₅ (e.g., RFID tag, RFID chip, etc.), which can sendactive RFID or passive RFID signals to, for example, an RFID reader(e.g., RFID reader 210 ₄). Typically, an RFID device can send a signalto an RFID reader, allowing a user identity to access a particularlocation, or in other cases, carry out a transaction (e.g., a tollboothtransaction).

The user identity 205 might carry a communication device 140 that is aBluetooth device 140 ₆. The Bluetooth device (e.g., a Bluetooth speaker)can be operable to pair with other devices (including othercommunications devices 140) through a Bluetooth network connection.

As mentioned, these devices can be carried on a user identity's person,or can be carried in some mode of transportation associated with theuser identity (e.g., a car, a van, a bus, a bicycle, a motorcycle,etc.). Additionally, other user identities can carry such communicationsdevices in the same mode of transportation as used by the user identity205 (e.g., carpooling in the same vehicle, riding the same bus, etc.).

FIG. 3 depicts a diagram 300 showing an example embodiment of thepresent application in which an identification analysis and association(IAA) module 305 (which, as mentioned above, can be implemented assoftware, hardware, or some combination thereof) is operable forcreating a container (e.g., record) in which a physical object(s) 310can be associated with one or more communications devices 140 _(1-n), aswell as other physical objects, of the user identity 205 (e.g.,possessed, carried, or operated by the user identity 205).

In example embodiments, one or more cameras 315 can capture an image ofa physical object(s) 310 (e.g., a car, a vehicle, a bicycle, a clothingor apparel item, a person) at a particular location (e.g., a trafficintersection, a tollbooth, a storefront).

At or near the same point in time, at the particular location, signalsfrom one or more communications devices 140 (e.g., a laptop computer 140₂, a mobile phone 140 ₃, a tablet computer 140 ₄, an RFID device 140 ₅,a Bluetooth device 140 ₆) can be received by one or more receivers 210,as described above with respect to FIG. 2.

At other locations, the same process can be repeated, in which images ofphysical objects are captured at a particular time, and in which signalsfrom communications devices 140 are received by receivers 210, also at aparticular time.

While the camera images, as well as the received signals from thecommunications devices 140 can be used by their respective networks forvarious respective applications (e.g., a mobile phone can connect withanother mobile phone, a signal from an RFID tag can be used to registera transaction, etc.), computing devices within those respective networks(not shown) can be programmed to be operable to send image datarepresentative of the physical objects 310 captured by cameras at thelocations, and also send signal data representative of the signals fromthe communications devices 140, to the IAA system 305. The signal datacontain identifiers (e.g., a cell phone mobile identification number orMIN, a MAC address of the communications device, and RFID number, etc.)that can be used to identify the signal as originating from eachcommunications device.

The IAA system 305 can be operable to receive image data representativeof images of a physical object captured at locations, along with timedata (e.g., time stamps) and location information (e.g., crossroads,addresses, or coordinates, such as longitude and latitude). The physicalobject can have one or more identifiable characteristics (in the case ofa motor vehicle, such information as the license number, the make andmodel of the vehicle, the color of the vehicle, etc.).

The IAA system 305 can also be operable to receive signal datarepresentative of a signal from one or more communications device at thelocations.

The IAA system 305 can place collected image data representative ofphysical objects and signal data in a “container” for analysis, wherethe container can comprise, for example, numerous entries, records,including of the collected image data. The container can be stored in arepository accessible to the IAA system 305 (e.g., repository 130).

Because the image data and the signal data are collected at varioustimes and locations (and these time stamps and location data can also betransmitted along with the image data and signal data), the analysis cancomprise an iterative process in which, based on time data and locationdata associated with the image data and the signal data, the IAA system305 can determine whether a physical object 310 is correlated to one ormore communications devices 140.

As an example, in a first instance, an image of many physical objects310, each having physical characteristics, can be captured by a camera(e.g., camera 315) at a particular location at a particular time. Theimage data can comprise a data element (e.g., marker, tag) thatindicates the location of the camera. Likewise, at the same location(e.g., within range of the camera location), many signals, each havingdevice identifiers, from a plurality of communications devices (e.g.,communications devices 140) can be received at the same (or nearly thesame) time by receivers 210. Signal data representative of a signal fromthe communications devices can be sent to the IAA system 305. Theinformation sent to the IAA system 305 can also comprise a data element(e.g., marker, tag) that indicates the location that each device'sdevice was received when the signal was received. Because many physicalobjects 310 and many signals were collected at this location and thistime, it may not be determinable in this first instance as to whichphysical object 310 is associated with which communications device 140.In another point in time, a second instance (or iteration), more imagesof physical objects 310 and signal data from communications devices 140can be collected at either the same location or another location. Inthis second instance, not all the same physical objects 310, or all thesame signals as from the first instance are present. After multipleinstances, an analysis of the data by the IAA system 305 might revealthat every time a particular physical object is present (e.g., aparticular car) determinable from the physical characteristics of theobject, a signal from a particular communications device (determinedbased on identifiers in the signal data associated with the device, suchas a device signature) is also received at the same time and samelocation, or at substantially the same time and substantially the samelocation. The IAA system 305 can, based on this analysis, create arecord for the particular physical object and associate it with thatparticular communications device.

Additionally, some of the identifiers (e.g., device signature) that canlead to the identification of the user of the communications device. Forexample, this identifier might be an international mobile equipmentidentifier (IMEI), or electronic serial number (ESN). Based on theidentifier number, the IAA system 305 can be operable to access a mobilephone carrier's subscriber or billing information (e.g., informationstored in a home location register (HLR), e.g., HLR 320). In thisscenario, not only can a communications device 140 be associated with aphysical object 310, but the identification of the user (e.g., by name,phone number, billing address) can also be associated with the physicalobject 310, as well as any other communications devices 140 and objectsassociated with the record for the physical object.

The IAA system 305 can, based on the analysis, create a record for theparticular physical object and associate it with a particularcommunications device or a particular identified user. For example, arecord (or container) for a particular public transit bus can show eachof the communications devices associated with the bus, and to the extentdeterminable, the identities of the users that travel on that busregularly. Additionally, the IAA system 305 can create a record for aparticular user, wherein the record shows all the physical objects 310(e.g., bus, car, picture, bicycle, clothing and apparel, etc.) and allthe communications devices 140 (e.g., mobile phone, tablet, etc.)associated with the particular user.

In some example embodiments, various views can be presented to a viewerof the record. For example, a physical object view can be presented whena user viewing the record selects a particular physical object (e.g.,selects a minivan). The view can present a listing of all users andcommunications devices associated with the physical object. A user viewcan be presented showing all physical objects and all communicationsdevices associated with a particular user (as well as other usersassociated with the user).

Various examples and use cases below further describe determinationsmade through this iterative process, and use cases for the technology.

FIGS. 4-5 illustrate a process that can be performed by the IAA system.In these procedures, and use case described below, a driver of a vehiclecan be more accurately identified. Here, the example of physical objects310 comprises motor vehicles. (e.g., cars, vans, trucks, buses) at atraffic intersection.

Existing systems used to identify drivers for traffic infractions ortoll collection rely mainly on cameras, RFID tags, or radar with anobserver. Typical tolling systems and red-light traffic cameras relyheavily on capturing by camera a vehicle's license plate (which canserve as a way to uniquely identify the vehicle), and/or by using RFIDtags placed inside an RFID device in the vehicle (e.g., mounted on thewindshield). This system is adequate for drivers who actively enrollwith RFID tags (e.g., submit identity information and paymentinformation) and who are the legitimate drivers of the registeredvehicles. Such systems target the identification of the vehicle (forexample, if a different driver from the enrolled driver is operating thevehicle) without any specific knowledge of the driver. Usually, it's theowner of the vehicle (or a family member of the owner) that causes thetraffic infraction or uses the toll lane. However, there are manydrivers who do not enroll with RFID tags, or they may drive someoneelse's car (e.g., thus avoiding the payment of tolls or fines, at leasttemporarily), such as in the case of a rental vehicle, or borrowing afriend or neighbor's vehicle. A communications device 140 can betraveling inside a vehicle, whether the device is on a person orsomewhere else in the vehicle. Through an iterative process, the IAAsystem 305 can trace a device to a particular vehicle, then the systemcan make a determination of who is inside a specific vehicle (e.g., sothat the driver responsible for the infraction or toll can beidentified).

In FIG. 4, cameras 350 (e.g., camera 1, 2, 3, and 4) at a trafficintersection may capture the images of all cars at the location 400(“location 950”), including cars A, B, C, D, E, F, and X. The devices inthis location may be all of the communications devices in thesevehicles, and some pedestrian devices, or devices in the nearbybuildings. Throughout the day, the same cameras 350 will capture imagesof different vehicles passing through this intersection, or no vehicleat all. The set of devices captured for processing during each samplemay reveal devices 140 that are always present even when there are novehicles around. Those devices can be eliminated from the virtualcontainers as noise. Assuming that Car X drives through thisintersection daily or even frequently, then the digital mobile signaturefor a communications device inside Car X. Communications devices can beon a person in a vehicle (e.g., in the driver's pocket), or justsomewhere inside the vehicle (e.g., on a cellphone holder mounted on thedashboard or in an air vent, in a backpack in the vehicle, on thepassenger seat, in the trunk, etc.). The signal data from acommunications device, which contains its signature, can be matched withevery time Car X (for example) appears, because the digital mobilesignature appears at the same time that an image of Car X is captured bya camera at the intersection.

In example embodiments, the IAA system 305 can be operable for creatinga virtual container (e.g., database, collection, series of records,etc.) that stores image data representative of images of the vehiclescaptured by a camera at the intersection intersections. The image datacan be sent by various camera systems that capture the images ofphysical objects 310. If the images have not been processed yet by thecamera systems to determine the image data, the IAA system 305 canperform that function. The image data can comprise various informationregarding each vehicle, to the extent determinable. This information caninclude the vehicle license plates, the vehicle makes, vehicle models,vehicle colors. The image data can also include, or have data appendedto it that includes, the RFID of the vehicles (e.g., RFID signature),and the calculated speed of the vehicles. The images data can alsocomprise, or be appended with, time and location data, the location datarepresentative of the location of the cameras where the images werecaptured. The location data can comprise, for example, an address, orcoordinates (such as given by latitude and longitude).

Signals from communications devices 210 within the range of the locationof the cameras at the intersection can also be received by variousreceivers 210. The signal data, which can also comprise time andlocation data (e.g., location of where the communications device 210 is)can also be sent by a system that is coupled to the signal receivers210. For example, a cellular communications system, or GPS system, canbe operable to send, either directly or indirectly, the location andtime data on the devices that connect to those systems.

In some example embodiments, virtual containers can be created, whereineach virtual container corresponds to the data gathered from aparticular location.

When image data, signal data, time and location data are all in the samecontainer or database, an analysis of that database and the items in itcan be performed by the IAA system 305. The IAA system 305 can beoperable to eliminate repeating devices that are not associated withvehicles. This can be implemented by evaluating communication devicesignatures that are duplicated in multiple snapshots without any vehiclebeing repeated in those snapshots. The IAA system 305 can be operable toeliminate devices that are captured when there are no vehicles in thevirtual container. These are negative samples taken when there are novehicles detected on the roads.

FIG. 5 illustrates an example in which communications devices 140 can bedetermined to be associated with physical objects 310 that are vehicles.As shown in FIG. 5, a virtual container 500 (e.g., database) can containthe image data captured by one or more cameras 315. The image data cancomprise various information about the vehicle, including its licenseplate. For simplicity, the identity of each vehicle is labeled byalphabet (e.g., Car A, Car B, etc.). Also included in the container isinformation gathered from the signals received from communicationsdevices 140, which can comprise a device ID. For simplicity, device IDsare labeled numerically in FIG. 5. The container 500 can also containlocation and time information, representing the times and locations thatthe images and signals were received. By way of illustration, thecontainer 500 is represented as a chart, but can be represented in otherfashions for representing databases and elements in databases. Also, forsimplicity, in the example shown, a limited number of vehicles anddevices are shown, and a limited number of sample times and locationsare shown.

As shown in FIG. 5, at a location (e.g., location 950), the images ofvarious vehicles (e.g., Car A, Car B, Car C, etc.) can be captured atvarious times, a few of which times are shown (e.g., 10/05/2017 8:00 AM,10/06/2017 8:05 AM). As illustrated, in the first instance (e.g.,sampling, iteration, etc.) at location 95 at 10/05/2017 8:00 AM, fivemotor vehicles were detected—Car A, Car X, Car D, Car E, Car G.Additionally, six devices were detected—Device 01, Device 07, Device 29,Device 21, Device 38, Device 76. In the first instance, it isindeterminable which devices are associated with which vehicles. Butafter more instances, it can be seen that each time Car X is present, sois Device 07 and Device 76. Thus, Device 07 and Device 76 can beassociated with Car X.

If a user can be identified for Device 76, for example, it then thedevice 07 can also be associated with the user. Thus, Device 76 mightbe, for example, a cellular phone, while Device 07 might be, for examplea tablet. Device 76, as a cellular phone, would have associated with itssignal data an identifier or device signature (as mentioned above, andIMEI or ESN) that would allow the IAA system 305 use to query a mobilephone carrier's subscriber or billing information (e.g., informationstored in a home location register (HLR), e.g., HLR 320). In thisscenario, the identification of the user (e.g., by name, phone number,billing address) can be associated with the Device 76, the vehicle CarX, and Device 07 as well.

Moving to FIG. 6, in example embodiments, the IAA system 305 can thencreate a record for each vehicle (e.g., a virtual container 600 for eachvehicle, vehicle container). The record may also be thought of asviewing related and associated data from the perspective of the vehicle(or some other physical object 310). For each vehicle container, the IAAsystem 305 can, as described above, then identify a set of thecommunications devices 140 that are present at that time and location,and then repeat after multiple times (and/or multiple locations) untilthe communications devices 140 that are detected a substantial number oftimes with the vehicle are identified. That set of devices 140 may notbe repeating in every single virtual container, but that set as a wholeis highly identifiable as the devices belonging to the driver for thisvehicle container. As the solution improves with machine learning (e.g.,by the IAA system 305), the signals from a set of determined devices canbe used as the digital mobile signature of the driver. As shown in FIG.6, Car X, by analyzing the captured image from a camera, might have beenidentified as a minivan with license plate HV 1701. More informationabout the van might be part of the record (e.g., make, model, etc.).More communications devices 140 (e.g., smartphone, smartwatch, tablet,RFID badge, etc.) might have been associated (based on the iterativeprocessed described above) with the vehicle container. Based on thedevice IDs associated with the vehicle, one or more users might havebeen identified (e.g., Vax Pottor, Cindy Pottor)).

Referring now to FIG. 7, in addition to creating a record, or virtualcontainer, for a specific vehicle, the IAA system 305 can also beoperable to create a record for a particular driver identity (e.g.,user). It can also be operable to associate the devices that are foundin the presence of the vehicles (e.g., based on time and location) intothis driver's container. The list of these devices can be considered thedigital mobile signature of the driver. If a subset of the list of thesedevices are present with a series of captured data showing a particularvehicle is present in the captured data, and the subset of the devicesare also present, then the driver identified in this driver container isthe candidate for the driver's identity

Here, in FIG. 7, the virtual container 700 for Vax Pottor is shown.Through the iterative process as described above, various physicalobjects 310, communications devices 140, and users can be associatedwith Vax Pottor. In addition to a vehicle that is a motor vehicle, otherphysical objects 310 such as apparel and bicycles can be associated witha user. The process to identify these physical objects 310 can follow asimilar iterative process to that of motor vehicles and devices insidethe motor vehicles. For example, a storefront camera might capture animage of a Vax Pottor wearing a particular apparel (e.g., a blue-coloredPolo-branded golf shirt) at several locations, while at the same timeand location, the Vax's device's signal data is received. After severaliterations (e.g., perhaps visiting 20 stores), a blue-coloredPolo-branded golf shirt can be associated with Vax and part of hisvirtual container. As a use case, the next time Vax Pottor's mobiledevice signature is received at a particular storefront, a targeted adfor a Polo-branded golf shirt can be sent to Vax Pottor's phone, basedon the fact that his virtual container has a Polo-branded shirtassociated with it.

FIG. 8 illustrates another example using toll lane cameras. When Car X,and Car A drive through the toll booth, the digital mobile signatures ofany of their communications devices 140 should both show up in thecaptured data. Then when either car drives through the toll lane, itbecomes clear which one belongs to Car X, and which one belongs to CarA, based on the signature that has been associated with each car (e.g.,Car X had devices 07 and device 76, each of which produced a signatureas it went through the toll area, assuming that receivers capable ofpicking up the signal data from those devices are present andinstalled). Thus, a group of devices can be used as digital signaturefor a specific driver. As the data changes, the set of devices can alsochange. The IAA system 305 can analyze the data and group the devices140 and physical objects 310 with relevance. It doesn't require the userto actively register an RFID, or any other communications device. Soeven for devices without a license plate or an RFID, the system canidentify who was present at a specific location, and at what time orspeed.

In another use case, a missing person can be tracked using the system.In this scenario, assume that Vax Pottor has been kidnapped and placedin a motor vehicle K. If Vax has on his person a communication device(such as an RFID badge that is used to access his work location) thathas become associated with Vax via the iterative processes, then thenext several iterations that Vax's RFID tag emanates a signal with anRFID signature, it can be associated with a physical object, such asmotor vehicle K. Or, it can be associated with an undisclosed locationthat can now be determined because once a communications signal from acommunications device has been received, and the motor vehicle containershows that the communications device is associated with Vax. Then,authorities can determine from which location the communication signaloriginated.

In example embodiments, the IAA system 305 can take the form of a device(or one or more devices, which may be networked) that comprises aprocessor and a memory that stores executable instructions that, whenexecuted by the processor, facilitate performance of operations, asdescribed below.

The operations can comprise receiving image data representative ofimages of physical objects (e.g., motor vehicles, vehicles, clothing andapparel, accessories, etc.) captured (e.g., by a camera) at locations(e.g., traffic intersections, streets, toll lanes, stores, storefronts,other places having cameras, etc.), wherein the physical objectscomprise identifiable features (e.g., a license plate number, brandlogo, etc.).

The operations can further comprise receiving signal data representativeof signals from communications devices (e.g., communications devices 140_(1-n)), wherein the signals were received by receivers (e.g., receivers210 _(1-n)) associated with the locations. The signal data can comprisedevice identifications (e.g., device IDs, device identifiers) that canbe used to identify each of the communications devices.

The operations can further comprise, based on time data and locationdata (e.g., address, coordinates, etc.) associated with the image dataand the signal data, determining whether one of the physical objects iscorrelated with one of the communications devices.

The operations can further comprise, in response to a determination thatone of the physical objects is correlated to one of the communicationsdevices (e.g., after multiple iterations, instances, etc.), storingrecord data (e.g., a container, database, etc.) comprising a first dataelement representative of the one of the physical objects and a seconddata element associated with the one of the communications devices.

The operations can further comprise using one of the deviceidentifications that is associated with the one of the physical objects,determining a user identity associated with the one of thecommunications devices (e.g., by querying a customer billing database,subscriber location registry, home location register, etc.) and storingrecord data comprising a third data element (e.g., name, address, etc.)representative of the user identity.

In non-limiting embodiments, a device (or system) is provided (e.g., IAAsystem 305) comprising a processor and a memory that stores executableinstructions that, when executed by the processor, facilitateperformance of operations as illustrated in flow diagram 900 of FIG. 9.

As shown at 910, the operations can comprise receiving image datarepresentative of images of a physical object (e.g., motor vehicle,vehicle, clothing and apparel, accessory, etc.) captured at locations(e.g., traffic intersections, streets, toll lanes, stores, storefronts,other places having cameras, etc.), wherein the physical object has anidentifiable characteristic (e.g., a license plate number, brand logo,etc.). The image data can be captured by a camera communicativelycoupled to the device. The physical object can be, for example, a motorvehicle, and the identifiable characteristic can comprises a licenseplate number of the motor vehicle.

Still on FIG. 9, the operations can, as shown at step 920, furthercomprise receiving signal data representative of a signal from acommunications device (e.g., communications devices 140), associatedwith a user identity, wherein the signal was received by receivers(e.g., receivers 210 _(1-n)) at the locations, and wherein the signalcomprises an identifier (e.g., device ID, device identifier) thatenables the user identity to be associated with the communicationsdevice. The identifier can enable the identity of the user identity tobe determined based on a subscriber location registry.

As shown in FIG. 9 at 930, the operations can further comprise, based ontime data and location data associated with the image data and thesignal data, determining whether the physical object is correlated tothe communications device and the user identity.

Also, in FIG. 9 at 940, the operations can further comprise, storing anelectronic record (e.g., a container, database, etc.) representative ofthe physical object.

At 950, the operations can further comprise associating a first dataentry associated with the user identity and a second data entryassociated with the communications device with the electronic record ofthe physical object.

The operations can further comprise, wherein the communications deviceis a first communications device, associating a third data entryassociated with a second communications device with the electronicrecord representative of the physical object, and wherein the secondcommunications device comprises signature data (e.g., RFID, Wi-Fisignature, device ID, etc.) that enables the second communicationsdevice to be identified.

The operations can further comprise using the electronic record tolocate the user identity. This can involve, for example, receiving, atan undisclosed location, a communication signal from the communicationsdevice, wherein the communication signal comprises the identifier, andusing the identifier and the electronic record, determining theundisclosed location.

The operations can further comprise sending a targeted message to thecommunications device based on the electronic record. Sending thetargeted message can comprise sending the targeted message to thecommunications device in response to a camera capturing an image of thephysical object. For example, if a storefront camera captures a motorvehicle associated with the user identity via the record, a targetedmessage (perhaps related to the store of the storefront camera) can besent to the communications device associated with the record.

In another non-limiting embodiment, a device or system (e.g., IAA system305) is provided, comprising a processor and a machine-readable storagemedium (e.g., memory) that stores executable instructions that, whenexecuted by the processor, facilitate performance of operations asillustrated in flow diagram 1000 of FIG. 10.

As shown at 1010, the operations can comprise receiving image files ofphysical objects captured at locations (e.g., a storefront camera in ashopping area), wherein the physical objects comprise identifiable imagefeatures. The physical objects can comprise, for example, an accessorycarried by a person identified by the user identity (e.g., who can bethe user identity), and the identifiable image features comprise a labelassociated with the accessory. The physical objects can comprise an itemof clothing worn by a person that is the user identity, and theidentifiable image features comprise a style of the clothing.

In FIG. 10, at 1020, the operations can comprise receiving datarepresentative of a signal from a communications device of a useridentity, wherein the signal was received by receivers at the locations,and wherein he signal comprises an identifier that allows thecommunications device to be associated with the user identity.

As shown in 1030, the operations can comprise determining whether thephysical objects are correlated to the communications device and theuser identity.

At 1040, the operations can comprise associating, with an electronicrecord of the user identity, a first entry associated with thecommunications device and a second entry associated with one of thephysical objects.

In non-limiting embodiments, a device or system (e.g., IAA system 305)is provided, comprising a processor and a memory that stores executableinstructions that, when executed by the processor, facilitateperformance of a method as illustrated in flow diagram 1100 of FIG. 11.

As shown at 1110, the method can comprise receiving image datarepresentative of physical objects captured at respective locations,wherein the physical objects comprise identifiable characteristics.

The method at 1120 can further comprise receiving a signal from acommunications device of a user identity, wherein the signal wasreceived by receivers at the respective locations, and wherein he signal(e.g., Wi-Fi signal, cellular signal, RFID signal) comprises anidentifier.

At 1130, the method can further comprise, using the identifier,determining a user identity associated with the communications device.

At 1140, the method can comprise determining whether the physicalobjects are correlated to the user identity.

The method can further comprise, at 1150, storing, by the device, recorddata comprising a first data element representative of the useridentity, a second data element associated with the communicationsdevice, and a third data element associated with one of the physicalobjects.

The method can optionally comprise generating a user interface thatrenders object information representing the physical objects and thecommunications device associated with the record data.

Referring now to FIG. 12, there is illustrated a block diagram of acomputer 1200 operable to execute the functions and operations performedin the described example embodiments. For example, a user device (e.g.,communications device 120) or servers (e.g., servers 120) can containcomponents as described in FIG. 12. The computer 1200 can providenetworking and communication capabilities between a wired or wirelesscommunication network and a server and/or communication device. In orderto provide additional context for various aspects thereof, FIG. 12 andthe following discussion are intended to provide a brief, generaldescription of a suitable computing environment in which the variousaspects of the innovation can be implemented to facilitate theestablishment of a transaction between an entity and a third party.While the description above is in the general context ofcomputer-executable instructions that can run on one or more computers,those skilled in the art will recognize that the innovation also can beimplemented in combination with other program modules and/or as acombination of hardware and software.

Generally, program modules include routines, programs, components, datastructures, etc., that perform particular tasks or implement particularabstract data types. Moreover, those skilled in the art will appreciatethat the various methods can be practiced with other computer systemconfigurations, comprising single-processor or multiprocessor computersystems, minicomputers, mainframe computers, as well as personalcomputers, hand-held computing devices, microprocessor-based orprogrammable consumer electronics, and the like, each of which can beoperatively coupled to one or more associated devices.

The illustrated aspects of the innovation can also be practiced indistributed computing environments where certain tasks are performed byremote processing devices that are linked through a communicationsnetwork. In a distributed computing environment, program modules can belocated in both local and remote memory data stores.

Computing devices typically include a variety of media, which caninclude computer-readable storage media or communications media, whichtwo terms are used herein differently from one another as follows.

Computer-readable storage media can be any available storage media thatcan be accessed by the computer and comprises both volatile andnonvolatile media, removable and non-removable media. By way of example,and not limitation, computer-readable storage media can be implementedin connection with any method or technology for storage of informationsuch as computer-readable instructions, program modules, structureddata, or unstructured data. Computer-readable storage media can include,but are not limited to, RAM, ROM, EEPROM, flash memory or other memorytechnology, CD-ROM, digital versatile disk (DVD) or other optical diskstorage, magnetic cassettes, magnetic tape, magnetic disk storage orother magnetic data stores, or other tangible and/or non-transitorymedia which can be used to store desired information. Computer-readablestorage media can be accessed by one or more local or remote computingdevices, e.g., via access requests, queries or other data retrievalprotocols, for a variety of operations with respect to the informationstored by the medium.

Communications media can embody computer-readable instructions, datastructures, program modules or other structured or unstructured data ina data signal such as a modulated data signal, e.g., a carrier wave orother transport mechanism, and comprises any information delivery ortransport media. The term “modulated data signal” or signals refers to asignal that has one or more of its characteristics set or changed insuch a manner as to encode information in one or more signals. By way ofexample, and not limitation, communication media include wired media,such as a wired network or direct-wired connection, and wireless mediasuch as acoustic, RF, infrared and other wireless media.

With reference to FIG. 12, implementing various aspects described hereinare devices that can comprise a computer 1200, the computer 1200comprising a processing unit 1204, a system memory 1206 and a system bus1208. The system bus 1208 couples system components comprising thesystem memory 1206 to the processing unit 1204. The processing unit 1204can be any of various commercially available processors. Dualmicroprocessors and other multi-processor architectures can also beemployed as the processing unit 1204.

The system bus 1208 can be any of several types of bus structure thatcan further interconnect to a memory bus (with or without a memorycontroller), a peripheral bus, and a local bus using any of a variety ofcommercially available bus architectures. The system memory 1206comprises read-only memory (ROM) 1227 and random access memory (RAM)1212. A basic input/output system (BIOS) is stored in a non-volatilememory 1227 such as ROM, EPROM, EEPROM, which BIOS contains the basicroutines that help to transfer information between elements within thecomputer 1200, such as during start-up. The RAM 1212 can also include ahigh-speed RAM such as static RAM for caching data.

The computer 1200 further comprises an internal hard disk drive (HDD)1214 (e.g., EIDE, SATA), which internal hard disk drive 1214 can also beconfigured for external use in a suitable chassis (not shown), amagnetic floppy disk drive (FDD) 1216, (e.g., to read from or write to aremovable diskette 1218) and an optical disk drive 1220, (e.g., readinga CD-ROM disk 1222 or, to read from or write to other high capacityoptical media such as the DVD). The hard disk drive 1214, magnetic diskdrive 1216 and optical disk drive 1220 can be connected to the systembus 1208 by a hard disk drive interface 1224, a magnetic disk driveinterface 1226 and an optical drive interface 1228, respectively. Theinterface 1224 for external drive implementations comprises at least oneor both of Universal Serial Bus (USB) and IEEE 1294 interfacetechnologies. Other external drive connection technologies are withincontemplation of the subject innovation.

The drives and their associated computer-readable media providenonvolatile storage of data, data structures, computer-executableinstructions, and so forth. For the computer 1200 the drives and mediaaccommodate the storage of any data in a suitable digital format.Although the description of computer-readable media above refers to aHDD, a removable magnetic diskette, and a removable optical media suchas a CD or DVD, it should be appreciated by those skilled in the artthat other types of media which are readable by a computer 1200, such aszip drives, magnetic cassettes, flash memory cards, cartridges, and thelike, can also be used in the example operating environment, andfurther, that any such media can contain computer-executableinstructions for performing the methods of the disclosed innovation.

A number of program modules can be stored in the drives and RAM 1212,comprising an operating system 1230, one or more application programs1232, other program modules 1234 and program data 1236. All or portionsof the operating system, applications, modules, and/or data can also becached in the RAM 1212. It is to be appreciated that the innovation canbe implemented with various commercially available operating systems orcombinations of operating systems.

A user can enter commands and information into the computer 1200 throughone or more wired/wireless input devices, e.g., a keyboard 1238 and apointing device, such as a mouse 1239. Other input devices 1240 (notshown) can include a microphone, camera, an IR remote control, ajoystick, a game pad, a stylus pen, touch screen, biometric reader(e.g., fingerprint reader, retinal scanner, iris scanner, hand geometryreader, etc.), or the like. These and other input devices are oftenconnected to the processing unit 1204 through an input device interface1242 that is coupled to the system bus 1208, but can be connected byother interfaces, such as a parallel port, an IEEE 2394 serial port, agame port, a USB port, an IR interface, etc.

A monitor 1244 or other type of display device can also be connected tothe system bus 1208 through an interface, such as a video adapter 1246.In addition to the monitor 1244, a computer 1200 typically comprisesother peripheral output devices (not shown), such as speakers, printers,etc.

The computer 1200 can operate in a networked environment using logicalconnections by wired and/or wireless communications to one or moreremote computers, such as a remote computer(s) 1248. The remotecomputer(s) 1248 can be a workstation, a server computer, a router, apersonal computer, portable computer, microprocessor-based entertainmentdevice, a peer device or other common network node, and typicallycomprises many or all of the elements described relative to thecomputer, although, for purposes of brevity, only a memory/data store1250 is illustrated. The logical connections depicted includewired/wireless connectivity to a local area network (LAN) 1252 and/orlarger networks, e.g., a wide area network (WAN) 1254. Such LAN and WANnetworking environments are commonplace in offices and companies, andfacilitate enterprise-wide computer networks, such as intranets, all ofwhich can connect to a global communications network, e.g., theInternet.

When used in a LAN networking environment, the computer 1200 isconnected to the local network 1252 through a wired and/or wirelesscommunication network interface or adapter 1256. The adapter 1256 canfacilitate wired or wireless communication to the LAN 1252, which canalso include a wireless access point disposed thereon for communicatingwith the wireless adapter 1256.

When used in a WAN networking environment, the computer 1200 can includea modem 1258, or is connected to a communications server on the WAN1254, or has other means for establishing communications over the WAN1254, such as by way of the Internet. The modem 1258, which can beinternal or external and a wired or wireless device, is connected to thesystem bus 1208 through the input device interface 1242. In a networkedenvironment, program modules depicted relative to the computer, orportions thereof, can be stored in the remote memory/data store 1250. Itwill be appreciated that the network connections shown are exemplary andother means of establishing a communications link between the computerscan be used.

The computer is operable to communicate with any wireless devices orentities operatively disposed in wireless communication, e.g., aprinter, scanner, desktop and/or portable computer, portable dataassistant, communications satellite, any piece of equipment or locationassociated with a wirelessly detectable tag (e.g., a kiosk, news stand,restroom), and telephone. This comprises at least Wi-Fi and Bluetooth™wireless technologies. Thus, the communication can be a predefinedstructure as with a conventional network or simply an ad hoccommunication between at least two devices.

Wi-Fi, or Wireless Fidelity, allows connection to the Internet from acouch at home, a bed in a hotel room, or a conference room at work,without wires. Wi-Fi is a wireless technology similar to that used in acell phone that enables such devices, e.g., computers, to send andreceive data indoors and out; anywhere within the range of a basestation. Wi-Fi networks use radio technologies called IEEE 802.11 (a, b,g, n, etc.) to provide secure, reliable, fast wireless connectivity. AWi-Fi network can be used to connect computers to each other, to theInternet, and to wired networks (which use IEEE802.3 or Ethernet). Wi-Finetworks operate in the unlicensed 2.4 and 5 GHz radio bands, at an 11Mbps (802.11b) or 54 Mbps (802.11a) data rate, for example, or withproducts that contain both bands (dual band), so the networks canprovide real-world performance similar to the basic “10BaseT” wiredEthernet networks used in many offices.

Referring now to FIG. 13, illustrated is a schematic block diagram of amobile device 1300 (which can be, for example, communications device140, or in some example embodiments, user premises device 230) capableof connecting to a network in accordance with some embodiments describedherein. Although a mobile handset 1300 is illustrated herein, it will beunderstood that other devices can be a mobile device, and that themobile handset 1300 is merely illustrated to provide context for theembodiments of the various embodiments described herein. The followingdiscussion is intended to provide a brief, general description of anexample of a suitable environment 1300 in which the various embodimentscan be implemented. While the description comprises a general context ofcomputer-executable instructions embodied on a machine-readable storagemedium, those skilled in the art will recognize that the innovation alsocan be implemented in combination with other program modules and/or as acombination of hardware and software.

Generally, applications (e.g., program modules) can include routines,programs, components, data structures, etc., that perform particulartasks or implement particular abstract data types. Moreover, thoseskilled in the art will appreciate that the methods described herein canbe practiced with other system configurations, comprisingsingle-processor or multiprocessor systems, minicomputers, mainframecomputers, as well as personal computers, hand-held computing devices,microprocessor-based or programmable consumer electronics, and the like,each of which can be operatively coupled to one or more associateddevices.

A computing device can typically include a variety of machine-readablemedia. Machine-readable media can be any available media that can beaccessed by the computer and comprises both volatile and non-volatilemedia, removable and non-removable media. By way of example and notlimitation, computer-readable media can comprise computer storage mediaand communication media. Computer storage media can include volatileand/or non-volatile media, removable and/or non-removable mediaimplemented in any method or technology for storage of information, suchas computer-readable instructions, data structures, program modules orother data. Computer storage media can include, but is not limited to,RAM, ROM, EEPROM, flash memory or other memory technology, CD ROM,digital video disk (DVD) or other optical disk storage, magneticcassettes, magnetic tape, magnetic disk storage or other magnetic datastores, or any other medium which can be used to store the desiredinformation and which can be accessed by the computer.

Communication media typically embodies computer-readable instructions,data structures, program modules or other data in a modulated datasignal such as a carrier wave or other transport mechanism, andcomprises any information delivery media. The term “modulated datasignal” means a signal that has one or more of its characteristics setor changed in such a manner as to encode information in the signal. Byway of example, and not limitation, communication media comprises wiredmedia such as a wired network or direct-wired connection, and wirelessmedia such as acoustic, RF, infrared and other wireless media.Combinations of the any of the above should also be included within thescope of computer-readable media.

The handset 1300 comprises a processor 1302 for controlling andprocessing all onboard operations and functions. A memory 1304interfaces to the processor 1302 for storage of data and one or moreapplications 1306 (e.g., a video player software, user feedbackcomponent software, etc.). Other applications can include voicerecognition of predetermined voice commands that facilitate initiationof the user feedback signals. The applications 1306 can be stored in thememory 1304 and/or in a firmware 1308, and executed by the processor1302 from either or both the memory 1304 or/and the firmware 1308. Thefirmware 1308 can also store startup code for execution in initializingthe handset 1300. A communications component 1310 interfaces to theprocessor 1302 to facilitate wired/wireless communication with externalsystems, e.g., cellular networks, VoIP networks, and so on. Here, thecommunications component 1310 can also include a suitable cellulartransceiver 1311 (e.g., a GSM transceiver) and/or an unlicensedtransceiver 1313 (e.g., Wi-Fi, WiMax) for corresponding signalcommunications. The handset 1300 can be a device such as a cellulartelephone, a PDA with mobile communications capabilities, andmessaging-centric devices. The communications component 1310 alsofacilitates communications reception from terrestrial radio networks(e.g., broadcast), digital satellite radio networks, and Internet-basedradio services networks.

The handset 1300 comprises a display 1312 for displaying text, images,video, telephony functions (e.g., a Caller ID function), setupfunctions, and for user input. For example, the display 1312 can also bereferred to as a “screen” that can accommodate the presentation ofmultimedia content (e.g., music metadata, messages, wallpaper, graphics,etc.). The display 1312 can also display videos and can facilitate thegeneration, editing and sharing of video quotes. A serial I/O interface1314 is provided in communication with the processor 1302 to facilitatewired and/or wireless serial communications (e.g., USB, and/or IEEE1394) through a hardwire connection, and other serial input devices(e.g., a keyboard, keypad, and mouse). This supports updating andtroubleshooting the handset 1300, for example. Audio capabilities areprovided with an audio I/O component 1316, which can include a speakerfor the output of audio signals related to, for example, indication thatthe user pressed the proper key or key combination to initiate the userfeedback signal. The audio I/O component 1316 also facilitates the inputof audio signals through a microphone to record data and/or telephonyvoice data, and for inputting voice signals for telephone conversations.

The handset 1300 can include a slot interface 1318 for accommodating aSIC (Subscriber Identity Component) in the form factor of a cardSubscriber Identity Module (SIM) or universal SIM 1320, and interfacingthe SIM card 1320 with the processor 1302. However, it is to beappreciated that the SIM card 1320 can be manufactured into the handset1300, and updated by downloading data and software.

The handset 1300 can process IP data traffic through the communicationcomponent 1310 to accommodate IP traffic from an IP network such as, forexample, the Internet, a corporate intranet, a home network, a personarea network, etc., through an ISP or broadband cable provider. Thus,VoIP traffic can be utilized by the handset 800 and IP-based multimediacontent can be received in either an encoded or decoded format.

A video processing component 1322 (e.g., a camera) can be provided fordecoding encoded multimedia content. The video processing component 1322can aid in facilitating the generation, editing and sharing of videoquotes. The handset 1300 also comprises a power source 1324 in the formof batteries and/or an AC power subsystem, which power source 1324 caninterface to an external power system or charging equipment (not shown)by a power I/O component 1326.

The handset 1300 can also include a video component 1330 for processingvideo content received and, for recording and transmitting videocontent. For example, the video component 1330 can facilitate thegeneration, editing and sharing of video quotes. A location trackingcomponent 1332 facilitates geographically locating the handset 1300. Asdescribed hereinabove, this can occur when the user initiates thefeedback signal automatically or manually. A user input component 1334facilitates the user initiating the quality feedback signal. The userinput component 1334 can also facilitate the generation, editing andsharing of video quotes. The user input component 1334 can include suchconventional input device technologies such as a keypad, keyboard,mouse, stylus pen, and/or touch screen, for example.

Referring again to the applications 1306, a hysteresis component 1336facilitates the analysis and processing of hysteresis data, which isutilized to determine when to associate with the access point. Asoftware trigger component 1338 can be provided that facilitatestriggering of the hysteresis component 1338 when the Wi-Fi transceiver1313 detects the beacon of the access point. A SIP client 1340 enablesthe handset 1300 to support SIP protocols and register the subscriberwith the SIP registrar server. The applications 1306 can also include aclient 1342 that provides at least the capability of discovery, play andstore of multimedia content, for example, music.

The handset 1300, as indicated above related to the communicationscomponent 1310, comprises an indoor network radio transceiver 1313(e.g., Wi-Fi transceiver). This function supports the indoor radio link,such as IEEE 802.11, for the dual-mode GSM handset 1300. The handset1300 can accommodate at least satellite radio services through a handsetthat can combine wireless voice and digital radio chipsets into a singlehandheld device.

As used in this application, the terms “system,” “component,”“interface,” and the like are generally intended to refer to acomputer-related entity or an entity related to an operational machinewith one or more specific functionalities. The entities disclosed hereincan be either hardware, a combination of hardware and software,software, or software in execution. For example, a component can be, butis not limited to being, a process running on a processor, a processor,an object, an executable, a thread of execution, a program, and/or acomputer. By way of illustration, both an application running on aserver and the server can be a component. One or more components canreside within a process and/or thread of execution and a component canbe localized on one computer and/or distributed between two or morecomputers. These components also can execute from various computerreadable storage media comprising various data structures storedthereon. The components can communicate via local and/or remoteprocesses such as in accordance with a signal comprising one or moredata packets (e.g., data from one component interacting with anothercomponent in a local system, distributed system, and/or across a networksuch as the Internet with other systems via the signal). As anotherexample, a component can be an apparatus with specific functionalityprovided by mechanical parts operated by electric or electroniccircuitry that is operated by software or firmware application(s)executed by a processor, wherein the processor can be internal orexternal to the apparatus and executes at least a part of the softwareor firmware application. As yet another example, a component can be anapparatus that provides specific functionality through electroniccomponents without mechanical parts, the electronic components cancomprise a processor therein to execute software or firmware thatconfers at least in part the functionality of the electronic components.An interface can comprise input/output (I/O) components as well asassociated processor, application, and/or API components.

Furthermore, the disclosed subject matter can be implemented as amethod, apparatus, or article of manufacture using standard programmingand/or engineering technique communications devices to produce software,firmware, hardware, or any combination thereof to control a computer toimplement the disclosed subject matter. The term “article ofmanufacture” as used herein is intended to encompass a computer programaccessible from any computer-readable device, computer-readable carrier,or computer-readable media. For example, computer-readable media caninclude, but are not limited to, a magnetic data store, e.g., hard disk;floppy disk; magnetic strip(s); an optical disk (e.g., compact disk(CD), a digital video disc (DVD), a Blu-ray Disc™ (BD)); a smart card; aflash memory device (e.g., card, stick, key drive); and/or a virtualdevice that emulates a data store and/or any of the abovecomputer-readable media.

As it employed in the subject specification, the term “processor” canrefer to substantially any computing processing unit or devicecomprising single-core processors; single-processors with softwaremultithread execution capability; multi-core processors; multi-coreprocessors with software multithread execution capability; multi-coreprocessors with hardware multithread technology; parallel platforms; andparallel platforms with distributed shared memory. Additionally, aprocessor can refer to an integrated circuit, an application specificintegrated circuit (ASIC), a digital signal processor (DSP), a fieldprogrammable gate array (FPGA), a programmable logic controller (PLC), acomplex programmable logic device (CPLD), a discrete gate or transistorlogic, discrete hardware components, or any combination thereof designedto perform the functions described herein. Processors can exploitnano-scale architectures such as, but not limited to, molecular andquantum-dot based transistors, switches and gates, in order to optimizespace usage or enhance performance of communications device. A processoralso can be implemented as a combination of computing processing units.

In the subject specification, terms such as “store,” “data store,” “datastorage,” “database,” “repository,” “queue”, “storage device,” andsubstantially any other information storage component relevant tooperation and functionality of a component, refer to “memorycomponents,” or entities embodied in a “memory” or components comprisingthe memory. It will be appreciated that the memory components describedherein can be either volatile memory or nonvolatile memory, or cancomprise both volatile and nonvolatile memory. In addition, memorycomponents or memory elements can be removable or stationary. Moreover,memory can be internal or external to a device or component, orremovable or stationary. Memory can comprise various types of media thatare readable by a computer, such as hard-disc drives, zip drives,magnetic cassettes, flash memory cards or other types of memory cards,cartridges, or the like.

By way of illustration, and not limitation, nonvolatile memory cancomprise read only memory (ROM), programmable ROM (PROM), electricallyprogrammable ROM (EPROM), electrically erasable ROM (EEPROM), or flashmemory. Volatile memory can comprise random access memory (RAM), whichacts as external cache memory. By way of illustration and notlimitation, RAM is available in many forms such as synchronous RAM(SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rateSDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), anddirect Rambus RAM (DRRAM). Additionally, the disclosed memory componentsof systems or methods herein are intended to comprise, without beinglimited to comprising, these and any other suitable types of memory.

In particular and in regard to the various functions performed by theabove described components, devices, circuits, systems and the like, theterms (comprising a reference to a “means”) used to describe suchcomponents are intended to correspond, unless otherwise indicated, toany component which performs the specified function of the describedcomponent (e.g., a functional equivalent), even though not structurallyequivalent to the disclosed structure, which performs the function inthe herein illustrated example aspects of the embodiments. In thisregard, it will also be recognized that the embodiments comprises asystem as well as a computer-readable medium comprisingcomputer-executable instructions for performing the acts and/or eventsof the various methods.

Computing devices typically comprise a variety of media, which cancomprise computer-readable storage media and/or communications media,which two terms are used herein differently from one another as follows.Computer-readable storage media can be any available storage media thatcan be accessed by the computer and comprises both volatile andnonvolatile media, removable and non-removable media. By way of example,and not limitation, computer-readable storage media can be implementedin connection with any method or technology for storage of informationsuch as computer-readable instructions, program modules, structureddata, or unstructured data. Computer-readable storage media cancomprise, but are not limited to, RAM, ROM, EEPROM, flash memory orother memory technology, CD-ROM, digital versatile disk (DVD) or otheroptical disk storage, magnetic cassettes, magnetic tape, magnetic diskstorage or other magnetic data stores, or other tangible and/ornon-transitory media which can be used to store desired information.Computer-readable storage media can be accessed by one or more local orremote computing devices, e.g., via access requests, queries or otherdata retrieval protocols, for a variety of operations with respect tothe information stored by the medium.

On the other hand, communications media typically embodycomputer-readable instructions, data structures, program modules orother structured or unstructured data in a data signal such as amodulated data signal, e.g., a carrier wave or other transportmechanism, and comprises any information delivery or transport media.The term “modulated data signal” or signals refers to a signal that hasone or more of its characteristics set or changed in such a manner as toencode information in one or more signals. By way of example, and notlimitation, communications media comprise wired media, such as a wirednetwork or direct-wired connection, and wireless media such as acoustic,RF, infrared and other wireless media.

Further, terms like “communications device,” “user device,” “mobiledevice,” “mobile,” station,” “access terminal,” “terminal,” “handset,”and similar terminology, can generally refer to a wireless deviceutilized by a subscriber or user of a wireless communication network orservice to receive or convey data, control, voice, video, sound, gaming,or substantially any data-stream or signaling-stream. The foregoingterms are utilized interchangeably in the subject specification andrelated drawings. Likewise, the terms “access point,” “node B,” “basestation,” “evolved Node B,” “cell,” “cell site,” and the like, can beutilized interchangeably in the subject application, and refer to awireless network component or appliance that serves and receives data,control, voice, video, sound, gaming, or substantially any data-streamor signaling-stream from a set of subscriber stations. Data andsignaling streams can be packetized or frame-based flows. It is notedthat in the subject specification and drawings, context or explicitdistinction provides differentiation with respect to access points orbase stations that serve and receive data from a mobile device in anoutdoor environment, and access points or base stations that operate ina confined, primarily indoor environment overlaid in an outdoor coveragearea. Data and signaling streams can be packetized or frame-based flows.

Furthermore, the terms “user,” “subscriber,” “customer,” “consumer,” andthe like are employed interchangeably throughout the subjectspecification, unless context warrants particular distinction(s) amongthe terms. It should be appreciated that such terms can refer to humanentities, associated devices, or automated components supported throughartificial intelligence (e.g., a capacity to make inference based oncomplex mathematical formalisms) which can provide simulated vision,sound recognition and so forth. In addition, the terms “wirelessnetwork” and “network” are used interchangeable in the subjectapplication, when context wherein the term is utilized warrantsdistinction for clarity purposes such distinction is made explicit.

Moreover, the word “exemplary,” where used, is used herein to meanserving as an example, instance, or illustration. Any aspect or designdescribed herein as “exemplary” is not necessarily to be construed aspreferred or advantageous over other aspects or designs. Rather, use ofthe word exemplary is intended to present concepts in a concretefashion. As used in this application, the term “or” is intended to meanan inclusive “or” rather than an exclusive “or”. That is, unlessspecified otherwise, or clear from context, “X employs A or B” isintended to mean any of the natural inclusive permutations. That is, ifX employs A; X employs B; or X employs both A and B, then “X employs Aor B” is satisfied under any of the foregoing instances. In addition,the articles “a” and “an” as used in this application and the appendedclaims should generally be construed to mean “one or more” unlessspecified otherwise or clear from context to be directed to a singularform.

In addition, while a particular feature may have been disclosed withrespect to only one of several implementations, such feature can becombined with one or more other features of the other implementations asmay be desired and advantageous for any given or particular application.Furthermore, to the extent that the terms “have”, “having”, “includes”and “including” and variants thereof are used in either the detaileddescription or the claims, these terms are intended to be inclusive in amanner similar to the term “comprising.”

The above descriptions of various embodiments of the subject disclosureand corresponding figures and what is described in the Abstract, aredescribed herein for illustrative purposes, and are not intended to beexhaustive or to limit the disclosed embodiments to the precise formsdisclosed. It is to be understood that one of ordinary skill in the artcan recognize that other embodiments comprising modifications,permutations, combinations, and additions can be implemented forperforming the same, similar, alternative, or substitute functions ofthe disclosed subject matter, and are therefore considered within thescope of this disclosure. Therefore, the disclosed subject matter shouldnot be limited to any single embodiment described herein, but rathershould be construed in breadth and scope in accordance with the claimsbelow.

What is claimed is:
 1. A method, comprising: receiving, by a systemcomprising a processor, image data representative of images of aphysical object captured at locations at times by public image capturingdevices; based on respective time-stamped location data representativeof respective time-stamped locations of communication devices,identifying, by the system, a communication device of the communicationdevices at the locations at the times; and assigning, by the system, thecommunication device to the physical object.
 2. The method of claim 1,wherein the public image capturing devices comprise a traffic camera. 3.The method of claim 1, wherein the public image capturing devicescomprise a security camera.
 4. The method of claim 1, wherein thephysical object is a vehicle.
 5. The method of claim 1, wherein thephysical object is a bicycle.
 6. The method of claim 1, wherein thephysical object is an apparel item.
 7. The method of claim 1, whereinthe physical object is a wearable accessory.
 8. A system, comprising: aprocessor; and a memory that stores executable instructions that, whenexecuted by the processor, facilitate performance of operations,comprising: obtaining image data representative of images of a physicalobject captured at locations at times by public cameras; based onrespective time-stamped location data representative of respectivetime-stamped locations of mobile devices, detecting a mobile device ofthe mobile devices at the locations at the times; and associating themobile device with the physical object.
 9. The system of claim 8,wherein the public cameras comprise a traffic camera.
 10. The system ofclaim 8, wherein the public cameras comprise a security camera.
 11. Thesystem of claim 8, wherein the public cameras comprise a tollboothcamera located at a tollbooth that captures vehicle image data.
 12. Thesystem of claim 8, wherein the physical object is a motor vehicle. 13.The system of claim 8, wherein the physical object is a clothing item.14. The system of claim 8, wherein the physical object is an accessoryitem.
 15. A non-transitory machine-readable medium, comprisingexecutable instructions that, when executed by a processor, facilitateperformance of operations, comprising: acquiring image datarepresentative of images of a physical object captured at locations attimes by cameras; based on respective time-stamped location data of usercommunication devices, recognizing a user communication device of theuser communication devices at the locations at the times; and linkingthe user communication device with the physical object.
 16. Thenon-transitory machine-readable medium of claim 15, wherein the camerascomprise an outdoor camera.
 17. The non-transitory machine-readablemedium of claim 15, wherein the cameras comprise an indoor camera. 18.The non-transitory machine-readable medium of claim 15, wherein thecameras comprise a store security camera.
 19. The non-transitorymachine-readable medium of claim 15, wherein the physical object is awearable item.
 20. The non-transitory machine-readable medium of claim15, wherein the physical object is a carriable accessory.